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Distribution fan-out for an efficient, failsafe traffic distribution in 
a packet network 

5 

The invention relates to a method for defining a distribution fan-out 
in a packet network for packet traffic having the same egress node for 
the purposes of an efficient, failsafe traffic distribution. 

10 A central objective of the refinement of packet networks is currently 
to be able to offer real-time services via packet networks. The 
development tasks include switching, networking and Internet technology 
aspects . 

15" Packet networks are conventionally used primarily for transmitting non- 
time-critical data such as file transfer or electronic mail. The aim of 
more recent developments is also to transmit services with real-time 
requirements such as telephony, which is conventionally handled via 
circuit-switched networks, and video information. 

20 

This intended expansion of the service spectrum involves corresponding 
requirements on transmission quality. For services with real-time 
transmission, specific quality parameters such as limits for data 
packet delay and loss must be complied with. In this context, the 
25 technical literature frequently refers to Quality of Service, 
abbreviated to QoS, parameters or requirements. 

The most widely used packet network technology, which is based on IP 
(Internet Protocol), conventionally provides only best effort routing 
30 for the transmission of packets. Packets are transmitted from point to 
point or from router to router, the relevant router only deciding 
locally about the onward transmission of the packets to the next 
router. Internet terminology refers to individual hops. Within the 
framework of said best effort method, no quality of service parameters 
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can be guaranteed. No corresponding monitoring of the delay times or 
packet loss rates is provided. These two parameters may assume 
considerable values, e.g. when bottlenecks occur in the case of 
individual routers or on individual links. 

5 

One approach to ensuring the monitoring necessary for quality of 
service level transmission in packet networks is to reserve paths from 
end to end or from host to host. Methods employing path reservation 
include ATM (Asynchronous Transfer Mode) or for the IP networks MPLS 

10 (Multi Protocol Label Switching) . Reserving complete paths has the 
disadvantage of high complexity, low flexibility and poor resource 
utilization. Other methods have therefore been developed for the IP 
network, which at least in part preserve the flexibility of the 
original IP concept using best effort. One such approach is the Diff 

15 Serve (Differentiated Services) concept whereby packets are prioritized 
on entry to a subnetwork and are handled within said subnetwork 
according to their prioritization. Ultimately, however, this approach 
does not lead to genuine quality of service guarantees but only to the 
introduction of class-of -service categories. 

20 

The object of the invention is to allow data transmission with quality 
of service cfuarantees over a packet network while avoiding the 
disadvantages of conventional methods. 

25 This object is achieved by a method according to Claim 1. 

The starting point for the method according to the invention is the 
following concept for networks with quality of service data 
transmission. Efficient data packet transmission which respects delay 
30 and loss rate limits necessary for quality of service transmission can 
be achieved by strict monitoring of the traffic volume in a network 
combined with a flexible distribution of the traffic within said 
network. Central to the following description is the efficient 
distribution of data packets within a packet network for which the 
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entire traffic volume can be limited by validity checks at the network 
edges . 

Let there be a packet network with nodes (e.g. formed by routers) . 
5 Further, let the nodes be networked using physical connections - 
hereinafter referred to as connection sections. According to the 
invention it will be set forth how packet traffic can be distributed 
within the network in such a way that bottlenecks or impairments due to 
the failure of transmission sections can be largely eliminated. 

10 

For describing the invention a number of terms will now be introduced 
or defined. As part of the concept for guaranteeing quality criteria 
for the transmission of data packets over a packet network using 
validity checks and traffic distribution, data packets having the same 

15 ingress and egress node are combined. The totality of such packets will 
hereinafter be referred to as a flow, i.e. a flow is constituted by the 
data packets which are transmitted between the same ingress and egress 
point of the network via any paths within the network. This definition 
differs from the normal definition of flow in which transmission from 

2 0 end point to end point, i.e. from host to host or from terminal to 

terminal, for example, is considered. Distribution fan-outs are defined 
for each flow and comprise the totality of the possible routes of data 
packets of a flow. It is advisable where possible to permit a number of 
different paths for packets of a flow in order to ensure flexibility. 

25 It is also possible to employ weightings on a section by section basis 
in order to weight certain paths or certain connection sections more 
heavily for traffic distribution, e.g. because a higher transmission 
capacity is available there. In order to characterize the distribution 
fan-outs more closely, the term link is used. A fan-out then consists 

30 of a plurality of (logical) links. A (logical) link denotes a 

(physical) connection section via which the associated fan-out of the 
link can transmit data packets. In contrast to the (physical) 
connection sections, the (logical) links are assigned a direction which 
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specifies in which direction the distribution fan-out of the link can 
transmit data packets via the connection section. 

According to the invention, network nodes are classified as a function 
5 of an egress node for flows. The class is determined from the minimum 
number of hops or connection sections between the relevant node and the 
egress node. The minimum n\imber of hops can be determined for IP 
networks, for example, using topology information exchanged by routing 
protocols such as SPF or OSPF. Network nodes having the same distance 

10 from the egress node in terms of the minimum number of hops belong to 
the same class. For the sake of simplicity, network nodes of class N 
will now be referred to, N being a natural number and denoting the 
minimum number of hops to the egress node. From nodes of class N, links 
can now be routed to nodes of class N-1, i.e. in the direction of the 

15 egress node. In order to have as large a multiplicity of routes as 
possible, it is advisable to introduce logical links for a node of 
class N > 1 for all connection sections to nodes of class N-1. The 
logical links thus introduced always lead from nodes of a class having 
a larger minimum number of hops (class N) to a class with a minimum 

20 number of hops that is fewer by 1 (class N-1) . The links thus defined 

consequently contain no loops. It is also possible to introduce logical 
links within a class, taking care to ensure loop freedom. In addition 
to loop freedom, account must be taken of the following two aspects 
when introducing logical links within a class: where possible, all 

25 nodes must have many outgoing links in order to have alternatives in 
the event of disturbances. For this reason the lower limit of the 
number of outgoing links for a class must be as large as possible.- The 
other aspect is that as many links as possible must be defined within a 
class in order to optimize the number of route alternatives, taking 

30 care to ensure loop freedom within the class . 



By introducing classes and defining links from nodes of the higher 
class to .the lower class in each case, a framework for flow-related 
distribution fan-outs is defined which can be supplemented by links 
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within the individual classes. Major advantages of this are efficiency 
and loop freedom. The traffic distribution according to the invention 
is concentrated on links between classes. By using the number of hops 
as the metric, the routing from higher to lower classes minimizes the 
5 route of the data packets. The routing or the distribution within 

classes can be restricted to a minimum, thereby ensuring paths that are 
as short as possible and consequently providing efficient routing. The 
routing from higher classes to lower classes of nodes is 
unidirectional . Loops containing nodes of more than one class are 
10 eliminated in this routing. The problem of establishing loop freedom in 
the network as a whole is reduced to defining links within classes of 
nodes while avoiding looping within the class. The original problem is 
therefore mapped to a problem of a considerably lower degree of 
complexity. 

15 

For loop-free defining of links within a class, the following procedure 
can be used: 

- The nodes of the class are sequenced according to the number of 

2 0 outgoing links or in the case of nodes with the same number of outgoing 
links according to the capacity of the incoming links. 

- For at least some of the nodes, the following steps are performed 
according to the sequence for each node: 

The shortest path from the relevant node to the set of nodes of the 
25 class which is fewer by 1 is identified, paths via the outgoing links 
leading directly to nodes of class N-1 being disregarded. By 
identifying the shortest path, traffic distribution within the class is 
minimized, i.e. efficient routing is ensured. In the case of plurality 
of paths with minimum distance to the next lower class, all can be 
30 examined for loop freedom. 

If an identified path does not lead to a loop within the nodes of 
the class, the link via the first connection section of the identified 
path is incorporated into distribution fan-outs as a link. In the case 
of a plurality of identified paths, one can be selected if there is 
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loop freedom or more than one link can be defined for the node in 
question. 

The inventive definition of distribution fan-outs has the advantage of 
5 high flexibility and low susceptibility to disturbance. The 

distribution fan-out defined according to the invention relates only to 
an egress node. From the distribution fan-out, a traffic distribution 
can be derived for all flows transmitted via the egress node by 
selecting links of the distribution fan-out. For example, the ingress 

10 node is included in the classification for a flow. The totality of the 
paths from the ingress node of the flow to the egress node, which are 
routed via links of the distribution fan-out, defines a subset of links 
of the distribution fan-out which in turn define a distribution fan-out 
for the flow in question. The routing tables of the routers of the 

15 packet network can now be set up according to the distribution fan-outs 
for flows. The routing or forwarding of data packets within the packet 
network then takes place according to the distribution fan-out for the 
associated flow. A flow can be distributed over a plurality of paths of 
the associated distribution fan-out in order to ensure a balanced 

20 traffic distribution. This distribution can take place e.g. according 

to connection membership of packets or depending on the destination and 
source address of the packet. Data transmission with QoS level can be 
implemented by limiting the entire traffic volume of the network and, 
by means of traffic distribution according to the invention, 

25 - avoiding delays by concentrating on routing from higher classes to 
lower classes and 

- avoiding traffic peaks (and therefore bottlenecks) by traffic 
distribution and alternative paths. 

30 Traffic distribution can be performed dynamically on the basis of 

current traffic values, the distribution fan-out being so designed that 
each individual node has as many alternatives as possible for 
forwarding data packets of a flow. 
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For all flows leaving the packet network at the egress node, the 
proposed classification according to an egress node can be used for 
reacting to link failures. As a bottleneck arises in the vicinity of 
the egress node in respect of route multiplicity, it is advisable to 
5 perform the classification at least for nodes in the vicinity of the 
egress node. For application in the event of any link failures 
affecting the flows in question, it is advisable to classify all the 
nodes via which traff ic associated with the egress node in question is 
» routed or to classify all the nodes of the data network. The method or 
10 the classification can be perfoirmed for all the egress nodes and 
therefore for all the possible flows. 

In the event of failure of an outgoing link of a node classified 
according to the invention, the following reactions are possible: if 

15 the node has two or more outgoing links, the traffic normally routed 
via the failed link can be distributed via the other link(s) of the 
node. If the single outgoing link of a node fails, the direction of the 
incoming links to the node having their egress point at nodes of the 
same class can be inverted. In the event of failure of the single 

20 outgoing link of a node which has no links from nodes of the same class 
feeding into it, all the links of other classes feeding into it, i.e. 
for a link of class N generally the links to nodes of class N+1 can be 
inverted. 

25 If the downtime exceeds a particular limit value, the class of the node 
with the failed link can be re-determined. 

The invention will now be explained in greater detail in the context of 
exemplary embodiments and accompanying drawings in which: 
30 • 

Figure 1 shows a network section with node • classification according 
to the invention 
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shows the definition of links between nodes of different 
classes 

shows the definition of links between nodes of the same 
class 

illustrates the bottleneck in the vicinity of an egress node 

shows the reaction to link failure by traffic diversion via 
alternative outgoing links 

shows the reaction to a failed link by inversion of an 
incoming link of the same class 

shows the reaction to link failure by inversion of links to 
nodes of other classes 

shows the reaction to link failure by reclassification of 
the node.* 
20 

For an egress node, a distribution fan-out encompassing all the nodes 
of the network is constructed in the following way: for all the nodes, 
the distance to the egress node is measured in the minimum number of 
hops. The number of hops then determines class membership. For each 

2 5 node of a class N, links leading to a node of class N-1 are then 

defined on all connection sections between the node and nodes of class 
N-1. The determination of nodes within a class takes place in the 
following steps. First the nodes of a class are ordered according to 
the niimber of outgoing links from the node and the capacity of the 

30 incoming links. For this assignment, links are considered in the 

sequence of the number of outgoing links, going from nodes with a small 
number of outgoing links to nodes with more outgoing links. In the case 
of nodes having the same number of outgoing links, those having a 
higher incoming link capacity are considered first. If the capacity of 
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Figure 6 
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the incoming links is not known, alternatively the number of incoming 
links can also be considered- In the sequence, links within the class 
. are defined for the nodes of a class N. The steps are then: 

5 1. Select a node of class N according to the sequence defined above. 

2. Identify the shortest path to the set of nodes of the class which 
is fewer by 1. This path must not lead via the outgoing links 
leading directly to nodes of class N-1. 

10 

3. If this path does not lead to a loop within the nodes of class N, 
the link via the first connection section of the identified path is 
incorporated into the distribution fan-out as the link. 

15 4. The next node of class N is then considered in the sequence defined 
above . 

In this way a maximally large number of links within a class is 
introduced which fulfills the two conditions of loop freedom and a 
20 lower limit that is as small as possible for the minimum number of 
outgoing links. 

Figure 1 shows by way of example 11 network nodes for which a 
classification according to the invention is performed. The egress node 
25 is indicated by a rectangle. Nodes of class 1 are represented by a 

circle, nodes of class 2 by a double circle and nodes of class 3 by a 
triple circle. Connection sections between the nodes are denoted by 
full lines. 

30 Figure 2 shows the introduction of links between nodes of different 

classes, the links from class 1 to class 0 are represented by a dotted . 
line and the direction by an arrowhead. The following links between 
class 1 and 0 exist: 
- From node 5 to node 4 
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-r From node 1 to node 4 - 

- From node 2 to node 4 

- From node 9 to node 4 . . 

5 Links from class 2 to class 1 are represented by a dashed line and 

their direction by arrowheads. The following class 2 to class 1 links 
exist : 

- From node 8 to node 5 

- From node 3 to node 5 
10 - From node 3 to node 1 

- From node 6 to node 1 

- From node 6 to node 9 

- From node 11 to node 9 

- From node 10 to node 9 
15 - From node 10 to node 2. 

Finally, the links from class 3 to class 2 are indicated by a dash- 
dotted line and by arrowheads. The following links are involved: 

- From node 7 to node 8 
20 - From node 7 to node 3 

- From node 7 to node 10. 



Figure 3 shows how links within classes are defined according to the 
method described above. Links within class 1 are indicated by dotted 
25 arrows and links within class 2 by dashed arrows. The links within 
class 1 comprise: 

- From node 5 to node 1 

- From node 1 to node 2 

- From node 9 to node 2 . 

30 

The links within class 2 comprise: 

- From node 10 to node 11 

- From node 11 to node 6 

- From node 11 to node 8 . 
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- From node 3 to node 6 

- From node 3 to node 8 . 

Links between different classes are identified by full-line arrows in 
5 Figure 3 . 

In Figure 4 all the links are indicated by full-line arrows. In the 
vicinity of the egress node 4, there is a certain bottleneck for 
topological reasons, as the route fan-out leads to .the same point, the 
10 egress node, for all routes. For example, it may be easily seen that, 
for a loop-free route fan-out, a node with only a single outgoing link 
exists, because if all the nodes of class 1 had a second outgoing link 
to another node of class 1, a loop would result. In Figure 4 this is 
node 2 which has only one outgoing link. 

15 

Figures 5 to 8 now show link failure reactions provided for according 
to the invention. 

In Figure 5, the link between nodes 6 and 9 has failed. As indicated by 
20 a dotted arrow, the traffic which would normally have been transmitted 
between nodes 6 and 9 is now carried via the links from node 6 to node 
1. 

In Figure 6 the single outgoing link from node 2 to node 4 is 
25 disturbed. As a reaction - indicated by dotted arrows - links to nodes 
of the same class are inverted and thereby become outgoing links. The 
direction of the link from node 1 to node 2 and the link from node 9 to 
node 2 is reversed. 

30 In Figure 7 the links between node 9 and node 2 and between node 9 and 
node 4 have failed. Node 9 therefore has no more outgoing links and 
also possesses no incoming links from nodes of the same class. As a 
reaction, all the incoming links from nodes of a higher class are 
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inverted. These are the links from node 6 to node 9, from node 11 to 
node 9 and from node 10 to node 9. 

Finally, Figure 8 shows the same disturbance as in Figure 7, a new 
5 classification of node 9 having taken place because of the duration of 
the problem. Node 9 is now classified as a node of class 3 instead of 
class 1. The dotted arrows now describe changed traffic routing 
compared to the undisturbed case because of the new classification of 
node 9 . 
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